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Abstract 

We perform a complete and detailed analysis of the flavor changing neutral current rare top 
quark decays t — > cl~^l~ and t — > cviVi at one-loop level in the Standard Model, Two Higgs Doublet 
Models (I and II) and in MSSM. The branching ratios are very small in all models, O(10~^^), 
except for the case of the unconstrained MSSM, where they can reach O(10~^) for e'^e" and ViVi, 
and 0(10^^) for t'^t" . This branching ratio is comparable to the ones for t — > cV,cH. We also 
study the production rates of single top and the forward-backward asymmetry in e~^e~ — > tc and 
comment on the observability of such a signal at the International Linear Collider. 
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I. INTRODUCTION 

With the advent of the CERN Large Hadron Colhder (LHC) |]]], 80 milhon top quark 
pairs will be produced per year j^. This number will increase by one order of magnitude 
with the high luminosity option. Therefore, the properties of top quarks can be examined 
with significant precision at LHC. Thus top quark physics will be a testing ground for new 
phenomena, be it electroweak symmetry breaking, or the existence of interactions forbidden 
in the Standard Model (SM). Flavor Changing Neutral Currents (FCNC) in general, and of 
the top quark in particular, play an important role for validation of the SM and for New 
Physics (NP) signals. In the SM, there are no FCNC mediated by the 7, Z, q or if-boson at 



tree level, and FCNC induced by radiative effects are highly suppressed 



Higher order 



contributions are proportional to {mj — m|)/M^, with mi,mj the masses of the quarks in 
the loop diagrams and Mw the W^-boson mass. Thus all top-quark induced FCNC in SM 
are highly suppressed. Their branching ratios predicted in the SM are of the order of 10~^^ 



to 10" 
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far away from present and even future reaches of either the Large Hadron 



Colhder (LHC) |5|,|6| or the International Linear Collider (ILC) Q- 

There are many models of NP in which the branching ratios for the two-body FCNC 
decays are much larger than those obtained in the SM, and rare top decays might be enhanced 



7, Z, if have been 



to reach detectable levels [8|. Rare FCNC two-body processes t 
extensively studied in the two-Higgs Doublet Model (2HDM)j9 



Right Symmetric Models 



Constrained 



3, HQ 




17L Il8l | and Unconstrained 



12l l. Alternative Left- 
21 



Minimal Supersymmetric Standard Model (MSSM), Left-Right Super symmetric Models l21l. 



22j | , top-assisted technicolor models j23|, U£ 



Supersymmetric Model with R-parity violation 
as well as models with extra singlet quarks [2^. 

In addition to the two-body rare decays of top quark, some of its rare three-body decays 
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e.g., t — cWWj_cZZ, bWZ have been considered in the literature within the SM j26 
and for NP 2^ |2^. These three body decays are suppressed with respect to two-body 
decays in the SM but some of them get comparably larger within models of NP, such as 
two-Higgs-Doublet especially after including finite- width effects j28|. In addition, it has 
been shown that the branching ratio for three-body decay t egg can exceed that of the 
two body decay t — » eg in both SM js^ and MSSM "s^. The three body decay t cqq has 
also been analyzed j3l|, |32|, and while the branching ratio is smaller than that of t — ^ egg, 
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it is competitive with t — > cV. 

The above facts strengthens the case for investigating top quark physics further in three 
body decays. The goal of the present paper is to analyze another three-body rare decay, 
namely t —>■ cll in several frameworks and compare it to both t ^ c-f and t —>■ cqq, q = u. 
This decay was previously analyzed in js^ in the framework of topcolor assisted technicolor 
models, and in j35[ as induced by scalar leptoquarks in a Pati-Salam model. For b quarks, it 
is known that under certain circumstances, h sl^l~ can be more significant than 6 — *• S7 
in restricting the parameter space, i.e., in supersymmetry in the large tan/3 region js^. 

The remainder of the paper is organized as follows: In Section II we present the calculation 
of t — > cl'^l" in the SM and in Section III we present the same decay in the Two Higgs Doublet 
Model. Section IV is dedicated to presenting the formalism and calculation oit cl^l~ in 
the MSSM (in both constrained and unconstrained versions). In each section, we present the 
Feynman diagrams and analyze the results obtained within the given model. We include, 
for completeness, the related decay t —* cviVi in Section V. Finally, we analyze the related 
production of the single top quark in e+e" tc + ic at the ILC in Section VI. We conclude 
and discuss experimental observation in Section VII. 



II. t cll IN THE SM 

In the SM, since FCNC are forbidden, the decay t cl^l~ is induced at one-loop level 
through charged currents, involving vertices for Wqq' in the loop. The Feynman diagrams 
for this process are depicted in Fig. ^ For our numerical evaluation, we used the following 
parameters: 

a{mt) = 1/132.5605 , Mw = 80.45 GeV , Mz = 91.1875 GeV , = 1 - M^/M^ , 
mt = 172.5 GeV, nib = 2.85 GeV, nic = 0.63 GeV, a,(mt) ^ 0.1068. (2.1) 

We obtained: 
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FIG. 1: The one-loop SM contributions to t ^ cl'^l in the 't Hooft-Feynman gauge. 

As expected, the branching ratios are very small since even at one loop, the process is 
suppressed by the Glashow-Iliopoulos-Maiani (GIM) mechanism.^ The SM signal cannot be 
detected in current or future high energy collider experiments; thus any signal would be an 
indication of New Physics. 

III. THE TWO-HIGGS-DOUBLET MODELS 

The Two Higgs Doublet Models (2HDM) are simple extensions of the SM, formed by 
adding an extra complex SU{2)l<^U{1)y scalar doublet to the SM Lagrangian. Motivations 

^ Though BR{t ce+e^) is smah, it is of same order of magnitude as BR{t cZ), and BR{t ct^t~) 
is of same order of magnitude as BR{t 07) 0. 
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FIG. 2: The one-loop 2HDM contributions to t ^ cl'^l in the 't Hooft-Feynman gauge. 



for such a extension include the possibility of having CP-violation in the Higgs sector, and 
the fact that some models of dynamical electroweak symmetry breaking yield the 2HDM 
as their low-energy effective theory 36|. There are three popular versions of this model in 
the literature, depending on how the two doublets couple to the fermion sector. Models 
I and II (2HDM-I, 2HDM-II) include natural flavor conservation 0, while model III 
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(2HDM-III 
tree level l39 



las the simplest extended Higgs sector that naturally introduces FCNC at the 
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The most general 2HDM scalar potential which is both SU {2)l®U{1)y and CP invariant 



is given by 



3^ 



A4(|$in$2|' - |<^>^$2|') + A5(3?($^$2) - viV2y + Ag [55($+$2)]' , (3.1) 

where $i and $2 have weak hypercharge Y=l, vi and V2 are respectively the vacuum expec- 
tation values of $1 and $2 and the Aj are real-valued parameters. Note that this potential 
violates softly the discrete symmetry $1 — $1, $2 ^2 by the dimension two term 
A53fJ($|'$2). The above scalar potential has 8 independent parameters {Xi)i=i,...fi, vi and V2. 

After the electroweak symmetry breaks, three of the original eight degrees of freedom 
associated to $1 and $2 correspond to the three Goldstone bosons (G^, G°), while the other 
five degrees of freedom reduce to five physical Higgs bosons: (both CP-even), (CP- 

odd), and H^. Their masses are obtained as usual by diagonalizing the scalar mass matrix. 
The combination vf + f| is fixed by the electroweak scale through vi + = {2\/2G f)"^ ■ 
Seven independent parameters are left, which are given in terms of four physical scalar masses 
(m/jO, m^^o, m^o, mj:^±), two mixing angles (tan/3 = V1/V2 and a) and the soft breaking term 
A5. 

In this analysis, we impose that, when the independent parameters are varied, the con- 
tributions to the 5p parameter from the Higgs scalars should not exceed the current limits 
from precision measurements 3|: \5p\ < 0.001. 

The Feynman rules in the general 2HDM are given in . The Feynman diagrams which 
contribute to t — > cl^l~ are given in Fig. [21 The full one-loop calculation presented here 
is done in the 't Hooft gauge with the help of FormCalc [4^. The parameters used are the 
same as for the standard model. We have tested analyticity for the independent parameters 
of the model and restricted the parameter space accordingly. The parameter space of the 
models are severely constrained by the perturbativity constraints (|Ai| < Svr). The situation 
becomes even more severe if one takes into account the unitarity bounds. The branching 
ratios for t — * c/~^/^ obtained running the 2HDM parameters over their allowed values are 
all negligibly small (same order as the SM and often numerically indistinguishible), and 
thus not likely to show up at the present or future colliders. There are few points in the 
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parameter space where t cl^l becomes enhanced (around 1-2 orders of magnitude) with 
respect to the SM predictions but this usually requires very small tan/5 values (< 0.1) 



which are excluded 



42l |. It is also possible to get some deviation from the SM values if the 



Higgs bosons {h^,H^,A^ and H^) are very light (around 100-200 GeV). Overall we do not 
obtain significant deviations from the SM results and for this reason we do not graph them 
separately. 



IV. THE MINIMAL SUPERSYMMETRIC STANDARD MODEL 

The MSSM constitutes the minimal supersymmetric extension of the SM. It includes 
all SM fields, as well as two Higgs doublets needed to keep anomaly cancellation. One 
Higgs doublet, H^, gives mass to the d-type fermions (with weak isospin -1/2), the other 
doublet, H^, gives mass to the w-type fermions (with weak isospin +1/2). All SM multiplets, 
including the two Higgs doublets, are extended to supersymmetric multiplets, resulting in 
scalar partners for quarks and leptons (squarks and sleptons) and fermionic partners for the 
SM gauge bosons and the Higgs bosons (gauginos and higgsinos). We do not consider effects 
of complex phases here, i.e. we treat all MSSM parameters as real. 

The superpotential of the MSSM Lagrangian is 

W = fiH'H^ + Yi'H^Ue'j^ + Y^^H^Q'd^ + Y^^H^Q%, (4.1) 

while the part of the soft-SUSY-breaking Lagrangian responsible for the non-minimal squark 
family mixing is given by 

= -QHMlhQ^ - uHM!,hu^ - d^HMlhd^ + K^Q^H% + Y^A'^Q^H^. (4.2) 

In the above expressions Q is the SU(2) scalar doublet, u, d are the up- and down-quark 
SU{2) singlets (Q, u, d represent scalar quarks), respectively, Yu^ are the Yukawa couplings 
and 2, j are generation indices. Here A^^ are the trilinear scalar couplings and H^'^ represent 
two SU (2) Higgs doublets with vacuum expectation values 
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where v = {\/2Gf)'^^^ = 246 GeV, and the angle /3 is defined by tan/3 = V2/V1, the ratio 
of the vacuum expectation values of the two Higgs doublets; and fi is the Higgs mixing 
parameter. 



The squark mass term of the MSSM Lagrangian is given by 

\ f D 

where we assume the following form of tVI^ 



(4.4) 
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(4.5) 



Ml 



Mi 

Lq 

R{u,c,t} 



^R{d,s,b} 



A 



c,t 



i^ + cos2/3(T,-g,s^)M|, 
+ ml^t + cos2(3Qtsl,Ml, 
D,{d,sM + ^ls,b + cos2/3QbS^M| , 
Au,c,t - /i cot /5 , Ad,s,b = Ad,s,b - fJ^tanp. 



Ml 



(4.6) 



with mq, Tg, Qg the mass, isospin, and electric charge of the quark q, Mz the Z-boson mass, 
sw = sin 6w and 6w the electroweak mixing angle. Since we are concerned with top quark 
physics, we assume that the squark mixing is significant only for transitions between the 
squarks of the second and third generations. These mixings are expected to be the largest 
in Grand Unified Models and are also experimentally the least constrained. The most 
stringent bounds on these transitions come from b —* s'y. In contrast, there exist strong 
experimental bounds involving the first squark generation, based on data from K^-K^ and 
^o_^o inixing Q- 

We define the dimensionless flavor-changing parameters (5^^£))ab (^7 B = L,R) from 
the flavor off-diagonal elements of the squark mass matrices in the following way. First, to 
simplify the calculation we assume that all diagonal entries M? ^ and M^^^^ ^ are set equal 
to the common value Ml^gy, and then we normalize the off-diagonal elements to Ml^gy 
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50l|5l|, 



(M, 



2 \U 



{S'S^n))AB = , (^^J, ^,J=2,3 A,B = L,R). (4.7) 

The matrix M.\ in Eq. ()4.5p can further be diagonahzed by an additional 6x6 unitary 
matrix Vu to give the up squark mass eigenvalues 

{M'^""^' = T^uMlr,. (4.8) 

For the down squark mass matrix, we also can define j as the similar form of Eq. (j4.8j) with 
the replacement of (M?)as {A,B = L,R) by (M?)^^ and Tu by F^^. Note that SU{2)l 
gauge invariance implies that {M^)ll = Kckm{M'^) llK^j^j^j and the matrices (M?.)^/, 
and {M'^LL are correlated. Since the connecting equations are rather complicated and 
contain several unknown parameters, we proceed by including the flavor changing parame- 
ters (5^(j^Pa_b as independent quantities, while restricting them using previously set bounds 
4^. Unlike some other approaches js^, the mass matrix in Eq. (j4.8p (and the similar one 
in the down-sector) is diagonalized and the flavor changing parameters enter into our ex- 
pressions through the matrix Ff/^^. So, in the top decays t cl~^l~ , the new flavor changing 
neutral currents show themselves in both gluino- squark- quark and neutralino-squark-quark 
couplings in the up-type squark loops and in the chargino-squark-quark coupling in the 
down-type squark loops. We briefly review the ingredients of the flavor-violation in each 
sector, then give the interactions responsible for the violation. 

The gluino, g, is the spin 1/2 superpartner (Majorana fermion) of the gluon. According 
to the generators of SU{3)c (color octet), there are 8 gluinos, all having the same Majorana 
mass 

mg = Ms. (4.9) 
In the super-CKM basis, the quark-up squark-gluino (g) interaction is given by 

3 

Cui^g = J2^9sT:, [uUruy^PL~g''K-^ti^uf^'''>''PRfK + ii-c] , (4.10) 

1=1 

where are the SU{3)c generators, Pl,r = (1 =F75)/2, i = 1,2,3 is the generation index, 
a = 1, . . . , 6 is the scalar quark index, and s, t are color indices. In the gluino interaction, 
the flavor changing effects from soft broken terms Mq, M? and Au on the observables are 
introduced through the matrix Fj/. The Feynman graphs generated by gluino contributions 
to the decay t — > d~^l~ are depicted in Fig El 





FIG. 3: The one-loop gluino contributions to f — > cl~^l in MSSM in the 't Hooft-Feynman gauge. 

The charginos xl' {i = 1, 2) are four component Dirac fermions. The mass eigenstates 
are obtained from the winos and the charged higgsinos iff, H2'. 

The chargino masses are defined as mass eigenvalues of the diagonahzed mass matrix, 

W ./,+ 



'Hi 



(4.11) 



mass 2 



X 



H.c. 



(4.12) 



or given in terms of two-component fields 



z^+ = (-^A+,V^+), ^- = (-zA-,^.) , 



(4.13) 



where X is given by 



X 



(4.14) 



M2 V2Mwsm/3 
\/2Mw cos/3 /i 

In the mass matrix, M2 is the soft SUSY-breaking parameter for the Majorana mass term, 
and /i is the Higgsino mass parameter from the Higgs potential. 

The physical (two-component) mass eigenstates are obtained via unitary (2 x 2) matrices 
U and V: 



(4.15) 
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The eigenvalues of the diagonahzed matrix 



m-+ 
m-+ 

A2 



(4.16) 



are given by 



Xl,2 



+ 4M^ cos^ 2/5 + 4M^(M2^ + /i^ + 2 /i M2 sin 2/5) ' } . (4.17) 

The relevant Lagrangian terms for the quark-down squark-chargino (xt) interaction are 
given by 

2 3 

^Wx+=E E {^^ KckmU Pl xt {^dV" da - [g f/.i (i^ci^M).,] Pr xt {^dT da 



a=l i,j=l 

[U^2 {KcKM Y^'^%j\ Pr xt iVDf^'^" + H.c. 

diag 



(4.18) 



where the index a refers to chargino mass eigenstates. Y^^ are the diagonal up- and down 




FIG. 4: The one-loop chargino contributions to t — > cl~^l in MSSM in the 't Hooft-Feynman 
gauge. 

quark Yukawa couplings, and V , U the chargino rotation matrices defined by U*M^+V~^ = 



11 



diag(m^+, The flavor changing effects arise from both the off-diagonal elements in the 

CKM matrix Kckm and from the soft supersymmetry breaking terms in F^). The Feynman 
graphs generated by chargino contributions to the decay t cl~^l^ are shown in Fig HI 




22 23 24 25 



FIG. 5: The one-loop neutralino contributions to t — > cl'^l in MSSM in the 't Hooft-Feynman 
gauge. 

Neutralinos Xi = 2, 3, 4) are four-component Majorana fermions. They are the mass 
eigenstates of the photino, 7, the zino, Z, and the neutral higgsinos, and H2, with 

The mass term in the Lagrangian density is given by 

£^o,„,,, = -^i^Y^^' + H.c. (4.20) 
with the two-component fermion flelds 

(^Y = H>^',-^>^M^m,i^H,) ■ (4.21) 
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The mass matrix Y is given by 

^ Ml -Mzsin6'iy cos/5 sin 6*11/ sin /5 

M2 Mz cos 6w cos 13 —Mz cos 9w sin /? 

— sin cos/3 cos ^vk cos /3 —fi 

y Mz sin 9w sin /5 — cos 9w sin /3 — /i 



(4.22) 



The physical neutrahno mass eigenstates are obtained with the unitary transformation ma- 
trix A^: 

X° = iV,,V^o z,j = l,...,4, (4.23) 
The diagonal mass matrix is then given by 



(4.24) 



the relevant Lagrangian terms for the quark-up squark neutralino (x°) interaction are 



E E i ^"1 3 ^ tan^H. Pl Xl {Tuf^'^'' - Yf^^ P, xl (r 

n=l i=l ^ * 



U) Ua 



fiYns + ^iVnitan^H^") Pn5L{^vTua-u,N^^Y^''^Pnxl{^vf^'''^''u, 



V2\ 



(4.25) 



where is the rotation matrix which diagonalizes the neutralino mass matrix M^o, 
N*M^oN~^ = diag(m^o, m^o, m^o, rn^o). As in the gluino case, FCNC terms arise only 
from supersymmetric parameters in Tu. The Feynman graphs generated by neutralino con- 
tributions to the decay t — > cl^l~ are given in FigEl 

Note that MSSM can be studied as a model in itself, or as a low energy realization of a 
supersymmetric grand unified scenario (SUSY GUT). In SUSY GUTs Mi, M2 and M3 are 
not independent but connected via 



m, = M3 = ^M2 



«s . ^9 , ^ , ^ 5 sin 6'^ , ^ 
— sin ^2^^^ Mi = - J^Ma. 



3 cos 9^ 



(4.26) 



92 C^om 

which results in a reduction of the number of independent parameters. We shall refer to this 
as the mSUGRA scenario and label the figures accordingly. 

In the unconstrained MSSM no specific assumptions are made about the underlying 
SUSY-breaking mechanism, and a parametrization of all possible soft SUSY-breaking terms 
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is used that does not alter the relation between the dimensionless couplings (which ensures 
that the absence of quadratic divergences is maintained). This parametrization has the 
advantage of being very general, but the disadvantage of introducing more than 100 new 
parameters in addition to the SM. While in principle these parameters (masses, mixing an- 
gles, complex phases) could be chosen independently of each other, experimental constraints 
from flavour- changing neutral currents, electric dipole moments, etc. seem to favour a certain 
degree of universality among the soft SUSY-breaking parameters. 

We now proceed to investigate the dependence of the branching ratio of t — > c/^/~ on the 
parameters of the supersymmetric model. In the case of flavor violating MSSM, only the 
mixing between the second and the third generations is turned on, and the dimensionless 
parameters (5's run over as much of the interval (0,1) as allowed. The allowed upper limits of 
(5's are constrained by the requirement that m-, j. > and consistent with the experimental 
lower bounds (depending on the chosen values of Msusy, A, tan /3, and fi). We assume a lower 
bound of 96 GeV for all up squark masses and 90 GeV for the down squark masses 1531 1 . 
The Higgs masses are calculated with FeynHiggs version 2.3 j^, with the requirement 
that the lightest neutral Higgs mass is larger than 114 GeV. Other experimental bounds 
included are 3|: 96 GeV for the lightest chargino, 46 GeV the lightest neutralino, and 195 
GeV for the gluino. We did not include the possible constraints coming from 6 ^ 57 or 
Bg — Bg mixing. The reason is the following: the most stringent constraints of these arise 
from the gluino contributions, and they restrict {51§)ab- Constraints on {5'^)ab are obtained 
under certain assumptions only. For instance, Cao et. al. in [s^, allow two flavor- violating 
parameters, {5'^)ll and (5^^)l_r, to be non-zero at the same time. This permits {5'^)lr to 
be of order one, but restricts (5^^)ll to be 0.5 or less. 

As in the case of the 2HDM, the constrained MSSM contribution to t — > cl^l~ is very 
small, often below the SM contribution. Thus, the only signals likely to be observed at 
the colliders would come from the unconstrained MSSM, which we investigate in detail. In 
Fig. ini we plot the dependence of the branching ratio of t — > ce^e~ on the flavor-changing 
parameter 5^^^. The 5'^' parameter drives the contributions from the gluino and neutralino 
sectors, while affects the chargino contribution only. The constrained MSSM values for 
the branching ratio correspond to 5'^'^ = 0.^ The first graph is obtained by allowing free 



The branching ratio is calculated by taking the top quark total decay width as 1.55 GeV. 
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FIG. 6: Upper left panel: BR's of t — > ce~^e~ decay as function of {5'^)aa without the GUT 
relations {rrig = 250 GeV). Upper right panel: BR's as function of {5'^)aa under the same condi- 
tions in mSUGRA scenarios. Lower left panel: BR's of t — > ce~^e~ decay as function of {5'^)lr- 
Lower right panel: BR's as function of A,B = L,R. The parameters are chosen as 

tan (3 = 10, m^o = AfsusY = 500 GeV, M2 = n = 200 GeV, and At = 1.2 TeV. 

values for the gaugino masses (no-GUT scenario); in practice this allows the gluino mass to be 
relatively light and the gluino contribution large. Taking only one {Sij^)AB 7^ 0, A, B = L, R 
at a time, the LL and RR contribution from the gluino are almost the same (as the gluino 
couplings are helicity blind, the only difference comes from the squark masses in the loop). 
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FIG. 7: Left panel: BR's of t — > ce^e~ decay as function of MsusY for various values of {5fj)LR 
with tan/3 = 10. Right panel: BR's as function of tan/3 under the same conditions with MsusY = 
500 GeV. The common parameters are chosen as rrij^o = 500 GeV, M2 = jJL 



200 GeV, and 



At = 1.2 TeV. m-o 



250 GeV for without GUT cases. 



For the neutralino, the LL contribution is larger than the RR one by one order of magnitude 
or more. The total branching ratio can reach 10^^ or so, for large allowed values of 
Once gaugino mass relations are imposed in accordance with the mSUGRA scenario, the 
gluino masses are forced to be larger and the gluino contributions are reduced by an order of 
magnitude, while the neutralino contributions are practically unaffected (upper right-sided 
panel). Throughout both scenarios, the chargino contribution, induced by the CKM matrix, 
is very small but non-zero. We give, in all graphs, the value of the SM branching ratio, for 
comparison; but not the value of the branching ration for 2HDM, which is indistinguishable 
numerically from that of the SM. In the lower left-sided panel we graph the branching ratio 
oft function of the flavor- and helicity-changing parameter As in the 



case of t ^ cV [2l|, this dependence is somewhat stronger than for the helicity-conserving 
parameter and the branching ratio can reach 10~^ for the no-GUT scenario. Finally in 
the lower right-sided panel, we show the dependence of he branching ratio of t ^ ce^e~ 
as a function of the parameter {5'^^)ab in the down squark sector. This parameter affects 
the chargino contributions only. The branching ratio can reach at most 10~^ from the 
chargino contributions alone; in this case {5'^)ab is set to zero and the gluino and neutralino 
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FIG. 8: Upper left panel: BR's of t — > cr+r" decay as function of {5f^)AA without the GUT 
relations {rrig = 250 GeV). Upper right panel: BR's as a function of {6'^)aa under the same 
conditions in mSUGRA scenario. Lower left panel: BR's as function of {5'^)lr- Lower right panel: 
BR's as function of {5'^)ab7 A,B = L,R. The parameters are chosen as tan/3 = 10, m^o = 
MsusY = 500 GeV, M2 = fi = 200 GeV, and At = 1.2 TeV. 

contributions are zero. Should the flavor violation come from the down squark sector only, 
the branching ratio would be one-to-two orders of magnitude smaller than if it originated in 
the up squark sector. 

In Fig. [7|we plot the dependence of the branching ratio oi t ce~^e~ on the scalar mass 
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FIG. 9: Left panel: BR's of t — > ct~^t~ decay as function of MsusY for various values of {Sf^)LR 
with tan/3 = 10. Right panel: BR's as function of MsusY for various values of {5'ij)lr with 
tan f3 = 10. The common parameters are chosen as m^o = 500 GeV, M2 = n = 200 GeV, and 
At = 1.2 TeV. Mg = 250GeV for without GUT cases. 

^susY and tan/3. MgusY affects scalar quark masses; one can see from the left-handed 
panel in Fig. U\ that the dependence is very weak, less than one order of magnitude change 
in going from 500 GeV to 1 TeV. The same is true for the tan (3 dependence which affects 
scalar quark masses and mixings, and the chargino/neutralino contribution: except for very 
low tan/3's, between and 5 when the branching ratio increases dramatically from 0, the 
branching ratio is insensitive to variations in intermediate values of tan/5 between 7 and 30. 

We investigated the same dependence for the decay t — > cfi~^fi~ and the results are 
practically identical, so we do not show them here. However, as expected, the branching 
ratio for t ct^t~ differs numerically, though not in its general variation pattern, from 
t — s> ce~'~e^ and we show it in Fig. |H| While the differences between the behavior of different 
curves are insignificant, the branching ratio for t ct^t~ is consistently one order of 
magnitude larger than either t — >■ ce+e" or t — c/i+/i~. Plotting the branching ratio of 
t cr~^r~ with respect to Msusy and tan /?, in Fig. IHl one can see the effects of the r 
lepton coupling to Higgs. In this, we assume flavor-violation in the up squark sector only, 
thus only the gluino and neutralino graphs are important. Looking at the diagrams, the 
decays proceed mostly though the penguins t — > 07*, t cZ* and t cH* followed by 
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7*, H* — s> r+r~. If the Higgs exchange was dominant, one would expect an enhancement 
in rr with respect to ee final state, of the order of {rrir/me)'^, while no change would be 
expected if the dominant exchange would be through the 7 or Z.^ The enhancement shows 
that there is some interference between the Higgs and vector boson graphs. 

V. t — > cz/jZ^j 

The transition t — > cz/jZ/j is generated at one-loop by the same operators as t —>■ cl^l~ . Of 
course, in this case, the experimental search for this rare decay is harder than for t — > cl^l~ 
(the signal will be a quark jet plus missing energy instead of a quark jet plus a lepton pair). 
As one cannot distinguish neutrino species, we sum over all three light families, which in 
principle could result in a rate for t c^z/jZ/j a factor of 3-4 larger than the rate for 
t cl^l~ . The Feynman diagrams which contribute to this decay in the SM are given in 
Fig. E3 for the 2HDM in Fig ^2 and for the gluino, chargino and neutralino contributions 
in MSSM in Figs. [El [El and d respectively. 




8 9 10 11 12 13 14 



FIG. 10: The one-loop SM contributions to t — > cuiUi in the 't Hooft-Feynman gauge. 

Fig. El is dedicated to the investigation of the branching ratio of t — * viVi. For the 
case in which the gluino mass is allowed to be relatively light (no GUT scenario), the largest 
contribution comes from the fiavor- and helicity-changing parameter in the up squark sector 
{^'u')lri though the contributions from the LL and RR parameters are comparable. We 
recover here the features from the decay t cl~^l~, while summing over neutrino fiavors 
results in a larger overall branching ratio than t — >■ ce~^e~ (The factor is slightly bigger 

^ Note that in the rr case there is an additional phase space supression. 
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FIG. 11: The one-loop 2HDM contributions to t — > cfjfj in the 't Hooft-Feynman gauge. 




FIG. 12: The one-loop gluino contributions to t — > cviUi in MSSM in the 't Hooft-Feynman gauge. 

than three). The down sector parameters {51§)ad contribute much less, especially {5'^)rr 
as there are no right-handed gauginos. At best, the branching ratio for t c'Y^ViVi can 
reach 10~^. This decreases somewhat for the case where we impose GUT relations between 
gaugino masses (upper right-handed panel). We plot the variation with {5ij)ab parameters 
only, for comparison, as they are dominant and the pattern of variation remains the same. 
The variation with the scalar mass Msusy and tan (3 are shown in the lower right-had panel. 
As for t — i> cl~^l~, the variation with Msusy is weak, the branching ratio decreasing by 




1 2 3 4 5 



FIG. 13: The one-loop chargino contributions to t — > ci/jfj in MSSM in the 't Hooft-Feynman 
gauge. 
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FIG. 14: The one-loop neutralino contributions to t ^ cz/jfj in MSSM in the 't Hooft-Feynman 
gauge. 

less than one order of magnitude when varying MgusY from 500 GeV to 1 TeV. Also, the 
variation with tan f] is very pronounced for low tan (3 (between and 5) but the branching 
ratio is insensitive to variations in intermediate values of tan j3 between 10 and 30. 

VI. PRODUCTION OF SINGLE TOP IN e+e" ^ tc AT THE ILC 

While the LHC as a factory of top quarks would allow to search for FCNC top quark 
decays, the single top quark production is also likely to be overwhelmed by the large back- 
ground. At the ILC at ^/s < 500 GeV, the signal e~^e~ tc is likely to be observed as a 
clear signal at relatively low energy, < 2m(. At such energies a single top quark production 
would present a clear signal, with the c being essentially a massless jet This produc- 
tion process has been considered by Chang et a l 15611 in the SM and its extensions, then by 
Huaug al in the SM. and later by L, al Qi. MSSM deluding SUSY-QCD corree- 
tions only. Lately, the process has been reconsidered by Cao et al j59|] in the unconstrained 
MSSM (SUSY QCD) with a nonzero mixing The conclusion is that the production 



in SM is impossib 
results agree with 



e to observe but it could be observable in models beyond the SM. Our 
for the same parameter values. Here, the charm associated top quark 
production at ILC, e'^e^ — > tc, is discussed in both constrained and unconstrained MSSM 
frameworks including gluino, chargino, neutralino and charged Higgs contributions, allowing 
flavor violation in both up and down squark sectors between second and third generation. 
Additionally, we calculate the forward-backward asymmetry. We assume that the electrons 
and positrons are unpolarized. 

The Feynman diagrams contributing to e"'"e~ tc process in MSSM can be easily read 
from the diagrams presented for the decay t — > c/"*"/^ in the previous sections. So, we don't 
repeat them here. Throughout this section the final state of the process is represented as tc 
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even though we symmetrize the final state by adding the charged conjugated part as well {tc 
+tc). The ultra-violet convergence of the process has been checked not only numerically but 
also analytically. After taking into account of the unitarity properties of the CKM matrix, 
the 6x6 matrix in the gluino sector, the 2x2 matrices U and V in the chargino sector, 
and 4x4 matrix in the neutralino sector, we have shown analytically that the amplitude 
of the process is ultra-violet divergent free. A similar analysis was carried out for the decay 
t — cl~^l~ discussed in the previous sections. In this section we adopt the same experimental 
bounds as in t — ^> cl~^l^ decay. We also apply an angular cut (10°) in the center of mass 
frame. In addition to the cross section, the forward-backward asymmetry (Afb) 

_ a(9 < 90°) - ajO > 90°) 

a(^<90°) + a(^>90°) ^ ^ 

in e+e" — *■ tc as observable is calculated. 

In Fig. the cross section a{e^e~ — tc) is presented in two-dimensional contour plots 
for various parameters. In the upper diagrams, a{e~^e~ — > tc) in {{S'^)LR,^/s) plane is 
shown with and without GUT relations. The cross section can reach 10~^ pb only for large 
fiavor-violating parameter values. The enhancement is about 3-4 orders of magnitude with 
respect to the unconstrainted MSSM results. In the lower diagrams, the contour diagram in 
(MgusY, At) shows that a small Msusy with At > 500 GeV favors a cross section of the order 
of 10"^ pb. The contours in {{S'^)lr, {S^)ll) plane show that a large cross section can be 
achieved by either assuming only one or both of the fiavor-violating parameters large. The 
cross section can still get as large as 10"^ pb. We further analyzed the dependence of the 
cross section with tan jS and M2 and found no significant change. 

In Fig. El we present a best case scenario for intermediate tan /5 values as a function of 
the gluino mass rrig at the center of mass energies 500 and 1000 GeV, respectively. The cross 
section can become only few times 10~^ pb for a very light gluino and is less than 10^^ pb 
for the constrained MSSM case. 

The last figure of the section. Fig. ^[ shows how the forward-backward asymmetry 
changes as a function of various MSSM parameters. The upper two diagrams show that the 
asymmetry ApB can be as large as 30% for moderate values of {5'^)lr at center of mass 
energies less than ti threshold. It is also seen that Ayb is not too sensitive to the gluino 
mass. As shown in the lower diagrams, A-pB can become even larger if Msusy < 300 GeV 
with I At I > 500 GeV. For Msusy > 500 GeV, the asymmetry is always smaller than 20%, 
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independent of the value of At. Note that the sign of ApB shows the differences between 
right-handed versus left-handed couplings. 

We would like to end this section by commenting on the observibility of both the decay 
t —>■ cl^l~ and the production e^e~ ^ tc + tc at ILC. In the case where the center of mass 
energy is less than 2mt ~ 350 GeV, we shouldn't expect any ti background so that we can 
assume the signal as top quark plus almost a massless c-jet. If we further assume that the 
integrated luminosity 500/6~^ is reached, one should expect to have more than 10 events at 
a/s = 300 GeV, Trig = 250 GeV with a large flavor violation (cr ~ 0.025/6). This could still 
be an observable signal after including detector efficiency factors since the background is 
very clear. If the center of mass energy is higher than the 2mt threshold, then background 
cuts will be required due to the ti production and the situation becomes worse than in 
the below threshold case. For the decay t cl~^l~, ILC might not be the best place to 
look. Assuming ^/s < 2mt, one can consider e^e~ tc ^ ccl~^l^ where / should be taken 
either as electron or muon. Due to its short life-time, / = r case is much more challenging. 
Without doubt, this wouldn't give any observable signal (considering the two top channel 
not feasible). For y/s > 500 GeV, e~^e~ ti bWcl~^l~, which yields more events but 
a more complicated background. For a{e~^e~ — > tf) ~ 1 pb, the number of events for the 
decay at integrated luminosity 500/6^^ becomes around 1.1 x 10^ x BR(t cl^l~)^ Since 
BR{t — > cl^l~) , / = e, /i can reach at most 10~^, we get less than one event. Further cuts 
needed will make t — ^ cl^l'^ not possible to be observed. However, if one looked at this decay 
at LHC, one can have 1.8 x 10^ x BR(t cl^l~) number of events at 100/6~^ integrated 
limunosity. A total efficiency of 10% is enough to get roughly 1.8 events. 



^ W boson is assumed to decay Icptonically. In this case, further cuts are necessary to distinguish the lepton 
from W decay with the signal. 
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FIG. 15: Upper left panel: BR's of t — > cY^^ViVi decay as function of {5'^^j^^)ab without the 
GUT relations (m^ = 250 GeV). Upper right panel: BR's as function of {5'^)ab under the same 
conditions in mSUGRA scenario. The parameters are chosen as tan [3 = 10, m^o = AfsusY = 500 
GeV, M2 = Id = 200 GeV, and At = 1.2 TeV. Lower left panel : BR's as function of MsusY for 
various values of {6'^)lr for various values of with tan/3 = 10. Lower right panel: BR's as 

a function of tan (3 under the same conditions with MsusY = 500 GeV. 
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FIG. 16: Upper left panel: The cross section of e~^e~ — > tc + tc in 2-dimensional contour plot 
without the GUT relations {nig = 250 GeV). Upper right panel: The cross section in 2-dimensional 
contour plot in mSUGRA scenario. The excluded regions are determined by the positivity of squark 
masses. The parameters are chosen as tan /3 = 10, my^o = MsusY = 500 GeV, M2 = fJ- = 200 GeV, 
and At = 1.2 TeV. Lower left panel: The cross section in 2-dimensional contour plot without 
GUT relations {rrig = 250 GeV) with {6Jj)lr = 0.5. Lower right panel: The cross section in 
2-dimensional contour plot without GUT relations {rrig = 250 GeV) under the same parameter 
values. 
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FIG. 17: Left panel: The cross section of e~^e ^ tc + tc as a function of rUg at y/s = 500 GeV. 
Right panel: The cross section as a function of nig at y/s = 1000 GeV. The parameters are chosen 
as tan/3 = 10, M2 = /i = 200 GeV, MsusY = 250 GeV, and At = 400 GeV. 
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FIG. 18: Upper left panel: The forward-backward asyymetry, Aps, for the process e~^e~ — > tc in 
2-dimensional contour plot without the GUT relations {rrig = 250 GeV). Upper right panel: Aps 
2-dimensional contour plot in mSUGRA scenario. The parameters are chosen as tan /3 = 10, ruj^o = 
MsusY = 500 GeV, M2 = fJ, = 200 GeV, and At = 1.2 TeV. Lower left panel : ApB in 2-dimensional 
contour plot without GUT relations {rrig = 250 GeV) with {5fj)LR = 0.5. Lower right panel: ApB 
in 2-dimensional contour plot without GUT relations {rrig = 250 GeV). 
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VII. SUMMARY AND CONCLUSION 



In the next few years, combined studies from the hadron (LHC) and hnear (ILC) colhders, 
with their abihty to produce large number of top quarks, should be able to test FCNC in its 
decays. Nonexistent at tree level, and very suppressed at one loop level in the SM, a signal 
of these processes will most certainly be a sign of New Physics. The dominant and most 
studied of these decays are the penguin ones: t c-f, eg, cZ and cH. But a complete study 
of rare decays is likely to unravel more about FCNC phenomenology. We have concentrated 
here on the rare decays t cl^l~ and t — > ci^jZ/j. While the dominant contribution to these 
decays comes from the penguin diagrams, followed by the decays 'y,Z,H these 
decays can proceed even in the case in which the two-body decays are forbidden, through 
box diagrams. Additionally, one can study the associated production cross section at ILC, 
e'^e" — s> tc, which is likely to provide a striking and almost background-free signal for single 
top quark production. 

Evaluation of the branching ratio for the decays t cl^l~ and t — >■ ci/ji/j has shown that 
they are strongly suppressed in SM and 2HDM; the branching ratios are expected to be of 
(9(10^^^) for e~^e~ and fi'^fi~ and (9(10~^^) for r+r~ and z/jZ/j. These values, while small, 
are of the same order of magnitude, or only one order smaller, than the two body decays. 
Though at this level neither are possible to observe at present or future colliders, it gives 
credence to the study of the rare decays t cl^l" and t — s> cViVi in beyond SM scenarios. 
In the constrained MSSM the branching ratios are of the same order, or even smaller than 
in the SM. However, in the unconstrained MSSM branching ratios of (9(10^'') for e"'"e~ and 
fi~^fi~ and O{10~^) for r+r~ and z/jZ/j can be obtained in the mSUGRA scenario; and these 
branching ratios can be one order of magnitude larger if one relaxes the GUT requirement 
on gaugino masses. The values obtained are comparable to the values for branching ratios 
obtained for t — > c-f, cZ and cH jsl. 

We also investigated the single top quark production in e+e~ tc + ic in the MSSM 
with and without GUT scenarios. The cross section can get as large as a few times 10~^ pb 
for the light gluino case with large flavor violation at ^/s = 500 GeV. This represents more 
than 5 orders of magnitude enhancement with respect to unconstrained MSSM prediction 
{6's = 0). In addition to the cross section, we calculated the forward-backward asymmetry 
and found large asymmetries in certain parts of the parameter space (it can become 50%) 
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so that such a measurement would be a better alternative to measuring cross sections for 
observing this channel. We commented on the observibility of both the decay and the 
production processes at the ILC. Lower energies (less than tt threshold) are favorable for 
the process e+e~ —>■ tc and we predicted roughly more than 10 events for certain parameter 
values. At energies larger than the tt threshold, the background becomes more challenging. 
For the decay t cl^l~ ,l = e,fi, LHC would be a better alternative for observing a signal 
than ILC, and could give an observable event rate if the total efficiency is around 10%. 
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